The Hand Mouse: GMM Hand-color Classi cation and Mean Shift Tracking
نویسندگان
چکیده
This paper describes an algorithm to detect and track a hand in each image taken by a wearable camera. We primarily use color information, however, instead of prede ned skin-color models, we dynamically construct handand background-color models by using a Gaussian mixture model to approximate the color histogram. Not only to obtain the estimated mean of hand color necessary for the restricted EM algorithm that estimates the GMM but to classify hand pixels based on the Bayes decision theory, we use a spatial probability distribution of hand pixels. Because the static distribution is inadequate for the hand-tracking stage, we translate the distribution with the hand motion based on the mean shift algorithm. Using the proposed method, we implemented the Hand Mouse, that uses the wearer's hand as a pointing device, on our Wearable Vision Sys-
منابع مشابه
Applying mean shift and motion detection approaches to hand tracking in sign language
Hand gesture recognition is very important to communicate in sign language. In this paper, an effective object tracking and hand gesture recognition method is proposed. This method is combination of two well-known approaches, the mean shift and the motion detection algorithm. The mean shift algorithm can track objects based on the color, then when hand passes the face occlusion happens. Several...
متن کاملReal Time Face and Hand Tracking With Correlation
In this paper, we demonstrate an effective tracking system for moving face and hand objects in real time. Our approach contains of three substages: adaptive background subtraction, face and hand detection using skin color and tracking them with pixels correlations respectively. There are famous robust tracking methods such as mean shift and active shape model in the literature. Despite providin...
متن کاملA Robust Method for Hand Tracking Using Mean-shift Algorithm and Kalman Filter in Stereo Color Image Sequences
Real-time hand tracking is a challenging task in many computer vision applications such as gesture recognition. This paper proposes a robust method for hand tracking in a complex environment using Mean-shift analysis and Kalman filter in conjunction with 3D depth map. The depth information solve the overlapping problem between hands and face, which is obtained by passive stereo measuring based ...
متن کاملThe Hand-mouse: A Human Interface Suitable for Augmented Reality Environments Enabled by Visual Wearables
This paper describes a wearable input interface the functions of which is similar to the usual mouse. The Hand-mouse is realized by classifying each pixel as a hand pixel or a background pixel based on approximation of a color histogram with the Gaussian mixture model and by tting the simple model of hand shapes into the classi ed hand pixels.
متن کاملHand Gesture Target Model Updating and Result Forecasting Algorithm based on Mean Shift
To propose a gesture model updating and results forecasting algorithm based on Mean Shift, and to solve the problem of target model changing and influenced tracking results in gesture target tracking process. Firstly, the background difference and skin color detection methods are used to detect and get gesture model, and the Mean Shift algorithm is used to track gesture and update the gesture m...
متن کامل